Multi‐modal fusion method for human action recognition based on IALC
نویسندگان
چکیده
In occlusion and interaction scenarios, human action recognition (HAR) accuracy is low. To address this issue, paper proposes a novel multi-modal fusion framework for HAR. framework, module called improved attention long short-term memory (IAL) proposed, which combines the SE-ResNet50 (ISE-ResNet50) with (LSTM). IAL can extract video sequence features skeleton of behaviour. improve performance HAR at high semantic level, obtained are fed into couple hidden Markov model (CHMM), IAL+CHMM method IALC developed based on probability graph model. test proposed method, experiments conducted HMDB51, UCF101, Kinetics 400k, ActivityNet datasets, 86.40%, 97.78%, 81.12%, 69.36% four respectively. The experimental results show that when environment complex, achieve more accurate target results.
منابع مشابه
Multimodal medical image fusion based on Yager’s intuitionistic fuzzy sets
The objective of image fusion for medical images is to combine multiple images obtained from various sources into a single image suitable for better diagnosis. Most of the state-of-the-art image fusing technique is based on nonfuzzy sets, and the fused image so obtained lags with complementary information. Intuitionistic fuzzy sets (IFS) are determined to be more suitable for civilian, and medi...
متن کاملAction Recognition based on Subdivision-Fusion Model
This paper proposes a novel Subdivision-Fusion Model (SFM) to recognize human actions. In most action recognition tasks, overlapping feature distribution is a common problem leading to overfitting. In the subdivision stage of the proposed SFM, samples in each category are clustered. Then, such samples are grouped into multiple more concentrated subcategories. Boundaries for the subcategories ar...
متن کاملMultimodal Biometrics Information Fusion for Efficient Recognition using Weighted Method
Biometrics do not provide unique identification. The matching process is probabilistic and is liable to measureable lapse error. A mistaken verfication or identification where the wrong person is matched against an enrolled user is termed a False Acceptance and the rate at which these occur is the False Acceptance Rate (FAR). Conversely, an error that occurs where a legitimate user fails to be ...
متن کاملMultimodal Recognition Method based on Ear and Profile Face Feature Fusion
The performance of ear recognition is influenced by pose variation. For the similar position of ear and profile face, a multimodal recognition method is proposed based on the feature fusion of ear and profile face information. A model for ear and profile face feature fusion and recognition is built. The Log-Gabor features of ear and profile face are first extracted separately, and two features ...
متن کاملAn enhanced method for human action recognition
This paper presents a fast and simple method for human action recognition. The proposed technique relies on detecting interest points using SIFT (scale invariant feature transform) from each frame of the video. A fine-tuning step is used here to limit the number of interesting points according to the amount of details. Then the popular approach Bag of Video Words is applied with a new normaliza...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Iet Image Processing
سال: 2022
ISSN: ['1751-9659', '1751-9667']
DOI: https://doi.org/10.1049/ipr2.12640